* unified benchmark scripts

* polish

Co-authored-by: baojiangnan <baojiangnan@kuaishou.com>

add sglang args in gen hidden states

polih

polish

polish

* Add subset options for opc

* lint & cat datasets

* fixed non-runnable examples

* polish

* polish

* fix missing import

* fix-args-type

* added tests for scripts

* added tests for scripts

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* added tests for scripts

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* polish

* support more sampling params

* remove recommended

* some comments

* lint

* Add examples of qwen3-coder-30B-A3B training script

* tiny fix

* Remove WANDB API key export from script to align with other examples

Removed Weights & Biases configuration from script.

* support checkpoint

* lint

* capture only required hidden states

* revert regen

* fix llama

* backward compatible

* Update specforge/modeling/target/custom_backend/qwen3_moe.py

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* gemini suggests

* fix

* fix phi

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* updated benchmark docs

* polish

* polish

* grouped args for better reference

* grouped args for better reference

* feature: optimize online training use hf backend less GPU memory

polish

polish

* polish

* added model-download-dir

* polish

* add missing

* Update specforge/modeling/target/custom_backend/qwen3_moe.py

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* fixed kv head replication in qwen3 moe

* poliosh

* poliosh

* docs:add benchmark refer

polish

polish

* polish

* optimized sglang backend memory usage

* poliosh

…ng (#378)

* feat: add training support for DeepSeek-v3 EAGLE-3 speculative decoding

Co-authored-by: GeLee-Q <865038696@qq.com>
Co-authored-by: Gao016 <yngao016@163.com>
Co-authored-by: yzlnew <yzlnew@gmail.com>

* fix: correct values in deepseek-v3-671b-eagle3.json

Co-authored-by: GeLee-Q <865038696@qq.com>
Co-authored-by: Gao016 <yngao016@163.com>
Co-authored-by: yzlnew <yzlnew@gmail.com>

* chore: update examples and templates for DeepSeek-V3 EAGLE-3

---------

Co-authored-by: chenyefei.cyf <chenyefei.cyf@U-9V5T77LW-2356.local>
Co-authored-by: GeLee-Q <865038696@qq.com>
Co-authored-by: Gao016 <yngao016@163.com>
Co-authored-by: yzlnew <yzlnew@gmail.com>

* supoort thinking models

update kimi-k2 and deepssek

polish

fix lint

fix kimi-k2 and gpt-oss

fix lint

* update parse to handle the Boundary token

---------

Co-authored-by: Shenggui Li <somerlee.9@gmail.com>

* add ds v3

* init

* modify sglang fit deepseek

* fix deepseek rparser

* ulysses finish

* ring offline finish

* tmp

* test pass

* test fail

* test

* clean up

* remove deepseek

* clean up

* clean up

* -

* -

* format

* fix unit test

---------

Co-authored-by: Yu Feng <fengyufengyu@didiglobal.com>
Co-authored-by: daiyajun <daiyajun@didiglobal.com>

* fixed templates

* polish

* feat: make dataloader num_workers configurable and fix prefetch_factor issue

1. scripts/train_eagle3.py:
   - Added  argument (default: 4) to replace the hardcoded value.
   - This allows adjusting worker count for low shared memory environments or debugging.

2. specforge/data/utils.py:
   - Fixed  when  is 0 by forcing  to None.

* Fix: add num_workers argument and fix dataloader bug

---------

Co-authored-by: yeshihai <yeshihai@MBP-LX22VD4VGG-2240.local>

* added regenerated datasets

* polish

Add --no-build-isolation flag to pip install command

Removed duplicate test run commands and unnecessary ls statements.